Skip to content

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 18, 2025

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 18, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3262

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 11 Pending

As of commit c60ab7a with merge base ff86ab7 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 18, 2025
[ghstack-poisoned]
[ghstack-poisoned]
@github-actions
Copy link

github-actions bot commented Dec 18, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}14$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 87.4438μs 86.4118μs 11.5725 KOps/s 12.3182 KOps/s $\textbf{\color{#d91a1a}-6.05\%}$
test_tensor_to_bytestream_speed[torch.save] 0.1470ms 0.1465ms 6.8248 KOps/s 7.1386 KOps/s $\color{#d91a1a}-4.40\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1160s 0.1158s 8.6322 Ops/s 8.0836 Ops/s $\textbf{\color{#35bf28}+6.79\%}$
test_tensor_to_bytestream_speed[numpy] 2.6934μs 2.6840μs 372.5772 KOps/s 362.2987 KOps/s $\color{#35bf28}+2.84\%$
test_tensor_to_bytestream_speed[safetensors] 40.5738μs 40.3360μs 24.7918 KOps/s 26.6874 KOps/s $\textbf{\color{#d91a1a}-7.10\%}$
test_simple 0.5601s 0.5567s 1.7962 Ops/s 1.7385 Ops/s $\color{#35bf28}+3.32\%$
test_transformed 1.1369s 1.1359s 0.8804 Ops/s 0.8605 Ops/s $\color{#35bf28}+2.31\%$
test_serial 1.7053s 1.6890s 0.5921 Ops/s 0.5852 Ops/s $\color{#35bf28}+1.17\%$
test_parallel 1.3687s 1.2402s 0.8063 Ops/s 0.8222 Ops/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-True-True-True-True] 0.1831ms 43.5881μs 22.9420 KOps/s 22.0691 KOps/s $\color{#35bf28}+3.96\%$
test_step_mdp_speed[True-True-True-True-False] 50.5610μs 25.2909μs 39.5399 KOps/s 38.3884 KOps/s $\color{#35bf28}+3.00\%$
test_step_mdp_speed[True-True-True-False-True] 48.8910μs 24.8168μs 40.2953 KOps/s 39.1233 KOps/s $\color{#35bf28}+3.00\%$
test_step_mdp_speed[True-True-True-False-False] 39.9100μs 13.8436μs 72.2354 KOps/s 70.6804 KOps/s $\color{#35bf28}+2.20\%$
test_step_mdp_speed[True-True-False-True-True] 84.6310μs 47.5408μs 21.0346 KOps/s 20.6463 KOps/s $\color{#35bf28}+1.88\%$
test_step_mdp_speed[True-True-False-True-False] 53.1500μs 28.2674μs 35.3764 KOps/s 35.3678 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-True-False-False-True] 67.7210μs 28.2495μs 35.3989 KOps/s 35.8729 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-True-False-False-False] 45.8910μs 16.7702μs 59.6297 KOps/s 59.3828 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[True-False-True-True-True] 76.4810μs 50.8106μs 19.6809 KOps/s 19.7171 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-False-True-True-False] 66.3210μs 30.6857μs 32.5885 KOps/s 32.4282 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-False-True-False-True] 50.2900μs 27.4792μs 36.3912 KOps/s 35.4321 KOps/s $\color{#35bf28}+2.71\%$
test_step_mdp_speed[True-False-True-False-False] 41.6000μs 16.8518μs 59.3409 KOps/s 59.5879 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[True-False-False-True-True] 79.8710μs 52.6324μs 18.9997 KOps/s 18.7100 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[True-False-False-True-False] 65.4110μs 33.4084μs 29.9326 KOps/s 29.5961 KOps/s $\color{#35bf28}+1.14\%$
test_step_mdp_speed[True-False-False-False-True] 66.4110μs 30.3572μs 32.9411 KOps/s 32.3500 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[True-False-False-False-False] 97.0910μs 19.3324μs 51.7265 KOps/s 52.0335 KOps/s $\color{#d91a1a}-0.59\%$
test_step_mdp_speed[False-True-True-True-True] 78.5510μs 49.9170μs 20.0333 KOps/s 19.7208 KOps/s $\color{#35bf28}+1.58\%$
test_step_mdp_speed[False-True-True-True-False] 79.0710μs 31.0405μs 32.2160 KOps/s 32.2306 KOps/s $\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-True-True-False-True] 2.3941ms 31.8786μs 31.3690 KOps/s 31.1062 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[False-True-True-False-False] 53.2910μs 18.7267μs 53.3998 KOps/s 53.7150 KOps/s $\color{#d91a1a}-0.59\%$
test_step_mdp_speed[False-True-False-True-True] 89.0410μs 52.8075μs 18.9367 KOps/s 18.7023 KOps/s $\color{#35bf28}+1.25\%$
test_step_mdp_speed[False-True-False-True-False] 75.7710μs 33.1998μs 30.1207 KOps/s 30.0724 KOps/s $\color{#35bf28}+0.16\%$
test_step_mdp_speed[False-True-False-False-True] 60.8010μs 34.1045μs 29.3216 KOps/s 29.1267 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[False-True-False-False-False] 50.9010μs 21.0215μs 47.5703 KOps/s 47.4175 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-False-True-True-True] 91.2410μs 55.9483μs 17.8736 KOps/s 17.7987 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-True-True-False] 64.6000μs 36.3223μs 27.5313 KOps/s 27.4121 KOps/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[False-False-True-False-True] 67.9310μs 34.2032μs 29.2370 KOps/s 28.9001 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-False-True-False-False] 50.6110μs 21.2114μs 47.1445 KOps/s 47.4778 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[False-False-False-True-True] 94.5020μs 58.4299μs 17.1145 KOps/s 17.1974 KOps/s $\color{#d91a1a}-0.48\%$
test_step_mdp_speed[False-False-False-True-False] 69.6110μs 38.4759μs 25.9903 KOps/s 25.6564 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-False-False-False-True] 69.8710μs 36.2921μs 27.5542 KOps/s 27.5761 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-False-False-False-False] 53.8210μs 23.5767μs 42.4147 KOps/s 42.2711 KOps/s $\color{#35bf28}+0.34\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8927s 0.7911s 1.2641 Ops/s 1.2682 Ops/s $\color{#d91a1a}-0.33\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7476s 0.6491s 1.5407 Ops/s 1.5410 Ops/s $\color{#d91a1a}-0.02\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7973s 1.7192s 0.5817 Ops/s 0.5847 Ops/s $\color{#d91a1a}-0.53\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5877s 1.4934s 0.6696 Ops/s 0.6742 Ops/s $\color{#d91a1a}-0.68\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0667s 1.9850s 0.5038 Ops/s 0.5084 Ops/s $\color{#d91a1a}-0.92\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.8556s 1.7643s 0.5668 Ops/s 0.5730 Ops/s $\color{#d91a1a}-1.08\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7758s 4.6531s 0.2149 Ops/s 0.2131 Ops/s $\color{#35bf28}+0.86\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.6339s 4.4660s 0.2239 Ops/s 0.2207 Ops/s $\color{#35bf28}+1.47\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.1992s 2.0524s 0.4872 Ops/s 0.4981 Ops/s $\color{#d91a1a}-2.18\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.8035s 1.7095s 0.5850 Ops/s 0.5823 Ops/s $\color{#35bf28}+0.47\%$
test_values[generalized_advantage_estimate-True-True] 10.8996ms 10.3599ms 96.5258 Ops/s 93.5682 Ops/s $\color{#35bf28}+3.16\%$
test_values[vec_generalized_advantage_estimate-True-True] 15.3770ms 11.2848ms 88.6145 Ops/s 56.3850 Ops/s $\textbf{\color{#35bf28}+57.16\%}$
test_values[td0_return_estimate-False-False] 0.2233ms 0.1278ms 7.8231 KOps/s 7.7339 KOps/s $\color{#35bf28}+1.15\%$
test_values[td1_return_estimate-False-False] 30.5543ms 29.0871ms 34.3795 Ops/s 34.2138 Ops/s $\color{#35bf28}+0.48\%$
test_values[vec_td1_return_estimate-False-False] 12.5265ms 11.3386ms 88.1943 Ops/s 56.0874 Ops/s $\textbf{\color{#35bf28}+57.24\%}$
test_values[td_lambda_return_estimate-True-False] 45.6665ms 43.5719ms 22.9505 Ops/s 23.3017 Ops/s $\color{#d91a1a}-1.51\%$
test_values[vec_td_lambda_return_estimate-True-False] 12.2971ms 11.3461ms 88.1361 Ops/s 56.4709 Ops/s $\textbf{\color{#35bf28}+56.07\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.6052ms 9.2738ms 107.8306 Ops/s 104.1897 Ops/s $\color{#35bf28}+3.49\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9057ms 1.5896ms 629.0804 Ops/s 654.2376 Ops/s $\color{#d91a1a}-3.85\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5362ms 0.4308ms 2.3213 KOps/s 2.3507 KOps/s $\color{#d91a1a}-1.25\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 35.5615ms 30.8396ms 32.4258 Ops/s 28.9613 Ops/s $\textbf{\color{#35bf28}+11.96\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.9858ms 1.7299ms 578.0514 Ops/s 577.6372 Ops/s $\color{#35bf28}+0.07\%$
test_dqn_speed[False-None] 1.8006ms 1.4440ms 692.5178 Ops/s 697.0528 Ops/s $\color{#d91a1a}-0.65\%$
test_dqn_speed[False-backward] 2.1626ms 1.9922ms 501.9511 Ops/s 511.5081 Ops/s $\color{#d91a1a}-1.87\%$
test_dqn_speed[True-None] 0.7896ms 0.5402ms 1.8511 KOps/s 1.8380 KOps/s $\color{#35bf28}+0.71\%$
test_dqn_speed[True-backward] 1.0331ms 0.9913ms 1.0088 KOps/s 985.0946 Ops/s $\color{#35bf28}+2.41\%$
test_dqn_speed[reduce-overhead-None] 0.8139ms 0.5421ms 1.8448 KOps/s 1.8547 KOps/s $\color{#d91a1a}-0.54\%$
test_dqn_speed[reduce-overhead-backward] 1.0679ms 1.0295ms 971.3135 Ops/s 1.0285 KOps/s $\textbf{\color{#d91a1a}-5.56\%}$
test_ddpg_speed[False-None] 3.6391ms 2.9279ms 341.5391 Ops/s 339.2874 Ops/s $\color{#35bf28}+0.66\%$
test_ddpg_speed[False-backward] 4.3176ms 4.2047ms 237.8310 Ops/s 238.8107 Ops/s $\color{#d91a1a}-0.41\%$
test_ddpg_speed[True-None] 1.7862ms 1.4277ms 700.4210 Ops/s 686.8194 Ops/s $\color{#35bf28}+1.98\%$
test_ddpg_speed[True-backward] 2.4596ms 2.4107ms 414.8146 Ops/s 342.0251 Ops/s $\textbf{\color{#35bf28}+21.28\%}$
test_ddpg_speed[reduce-overhead-None] 1.8049ms 1.4062ms 711.1423 Ops/s 694.5793 Ops/s $\color{#35bf28}+2.38\%$
test_ddpg_speed[reduce-overhead-backward] 2.4747ms 2.3862ms 419.0789 Ops/s 411.9895 Ops/s $\color{#35bf28}+1.72\%$
test_sac_speed[False-None] 9.4659ms 8.1257ms 123.0666 Ops/s 123.4096 Ops/s $\color{#d91a1a}-0.28\%$
test_sac_speed[False-backward] 11.8102ms 11.4148ms 87.6056 Ops/s 87.5454 Ops/s $\color{#35bf28}+0.07\%$
test_sac_speed[True-None] 2.5991ms 2.1985ms 454.8454 Ops/s 423.1123 Ops/s $\textbf{\color{#35bf28}+7.50\%}$
test_sac_speed[True-backward] 4.2521ms 4.1417ms 241.4479 Ops/s 241.5952 Ops/s $\color{#d91a1a}-0.06\%$
test_sac_speed[reduce-overhead-None] 2.8989ms 2.2514ms 444.1758 Ops/s 453.5355 Ops/s $\color{#d91a1a}-2.06\%$
test_sac_speed[reduce-overhead-backward] 4.2783ms 4.1502ms 240.9506 Ops/s 232.4787 Ops/s $\color{#35bf28}+3.64\%$
test_redq_speed[False-None] 12.7782ms 10.6652ms 93.7627 Ops/s 93.2862 Ops/s $\color{#35bf28}+0.51\%$
test_redq_speed[False-backward] 23.9053ms 18.9812ms 52.6837 Ops/s 53.2527 Ops/s $\color{#d91a1a}-1.07\%$
test_redq_speed[True-None] 5.0183ms 4.5900ms 217.8660 Ops/s 211.3429 Ops/s $\color{#35bf28}+3.09\%$
test_redq_speed[True-backward] 10.6459ms 10.1135ms 98.8781 Ops/s 98.5943 Ops/s $\color{#35bf28}+0.29\%$
test_redq_speed[reduce-overhead-None] 5.0647ms 4.5799ms 218.3433 Ops/s 215.7067 Ops/s $\color{#35bf28}+1.22\%$
test_redq_speed[reduce-overhead-backward] 10.6833ms 10.2521ms 97.5406 Ops/s 97.8052 Ops/s $\color{#d91a1a}-0.27\%$
test_redq_deprec_speed[False-None] 14.2062ms 11.4334ms 87.4629 Ops/s 89.4813 Ops/s $\color{#d91a1a}-2.26\%$
test_redq_deprec_speed[False-backward] 16.9627ms 16.4459ms 60.8053 Ops/s 61.9621 Ops/s $\color{#d91a1a}-1.87\%$
test_redq_deprec_speed[True-None] 4.1059ms 3.7652ms 265.5880 Ops/s 273.9988 Ops/s $\color{#d91a1a}-3.07\%$
test_redq_deprec_speed[True-backward] 8.3853ms 7.8772ms 126.9492 Ops/s 132.6718 Ops/s $\color{#d91a1a}-4.31\%$
test_redq_deprec_speed[reduce-overhead-None] 4.2287ms 3.7603ms 265.9347 Ops/s 272.9522 Ops/s $\color{#d91a1a}-2.57\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.1454ms 7.9009ms 126.5672 Ops/s 133.3383 Ops/s $\textbf{\color{#d91a1a}-5.08\%}$
test_td3_speed[False-None] 9.1219ms 8.2031ms 121.9048 Ops/s 122.4662 Ops/s $\color{#d91a1a}-0.46\%$
test_td3_speed[False-backward] 11.6917ms 11.0946ms 90.1340 Ops/s 90.8269 Ops/s $\color{#d91a1a}-0.76\%$
test_td3_speed[True-None] 1.9387ms 1.8789ms 532.2393 Ops/s 530.9997 Ops/s $\color{#35bf28}+0.23\%$
test_td3_speed[True-backward] 3.8604ms 3.7460ms 266.9499 Ops/s 265.0102 Ops/s $\color{#35bf28}+0.73\%$
test_td3_speed[reduce-overhead-None] 1.8977ms 1.8619ms 537.0996 Ops/s 540.9909 Ops/s $\color{#d91a1a}-0.72\%$
test_td3_speed[reduce-overhead-backward] 4.5254ms 3.8600ms 259.0648 Ops/s 223.0758 Ops/s $\textbf{\color{#35bf28}+16.13\%}$
test_cql_speed[False-None] 30.0242ms 26.8551ms 37.2369 Ops/s 37.2505 Ops/s $\color{#d91a1a}-0.04\%$
test_cql_speed[False-backward] 39.8787ms 36.4220ms 27.4560 Ops/s 27.6327 Ops/s $\color{#d91a1a}-0.64\%$
test_cql_speed[True-None] 13.0887ms 12.7142ms 78.6525 Ops/s 79.2585 Ops/s $\color{#d91a1a}-0.76\%$
test_cql_speed[True-backward] 19.7319ms 18.8836ms 52.9559 Ops/s 54.3266 Ops/s $\color{#d91a1a}-2.52\%$
test_cql_speed[reduce-overhead-None] 13.2880ms 12.7572ms 78.3873 Ops/s 79.9671 Ops/s $\color{#d91a1a}-1.98\%$
test_cql_speed[reduce-overhead-backward] 19.4931ms 18.9035ms 52.9004 Ops/s 53.5721 Ops/s $\color{#d91a1a}-1.25\%$
test_a2c_speed[False-None] 5.8948ms 5.5595ms 179.8736 Ops/s 178.4061 Ops/s $\color{#35bf28}+0.82\%$
test_a2c_speed[False-backward] 12.5572ms 12.1858ms 82.0625 Ops/s 81.9341 Ops/s $\color{#35bf28}+0.16\%$
test_a2c_speed[True-None] 3.9677ms 3.7787ms 264.6383 Ops/s 255.0134 Ops/s $\color{#35bf28}+3.77\%$
test_a2c_speed[True-backward] 9.3200ms 8.9098ms 112.2363 Ops/s 108.0875 Ops/s $\color{#35bf28}+3.84\%$
test_a2c_speed[reduce-overhead-None] 4.1858ms 3.7817ms 264.4301 Ops/s 265.5707 Ops/s $\color{#d91a1a}-0.43\%$
test_a2c_speed[reduce-overhead-backward] 9.2882ms 8.9932ms 111.1947 Ops/s 104.8605 Ops/s $\textbf{\color{#35bf28}+6.04\%}$
test_ppo_speed[False-None] 6.2421ms 6.0230ms 166.0308 Ops/s 164.4974 Ops/s $\color{#35bf28}+0.93\%$
test_ppo_speed[False-backward] 13.3806ms 12.8594ms 77.7639 Ops/s 77.5296 Ops/s $\color{#35bf28}+0.30\%$
test_ppo_speed[True-None] 3.8505ms 3.6795ms 271.7790 Ops/s 272.1631 Ops/s $\color{#d91a1a}-0.14\%$
test_ppo_speed[True-backward] 8.9609ms 8.6743ms 115.2826 Ops/s 111.7804 Ops/s $\color{#35bf28}+3.13\%$
test_ppo_speed[reduce-overhead-None] 3.9207ms 3.6405ms 274.6903 Ops/s 272.5883 Ops/s $\color{#35bf28}+0.77\%$
test_ppo_speed[reduce-overhead-backward] 9.1489ms 8.9245ms 112.0513 Ops/s 108.9463 Ops/s $\color{#35bf28}+2.85\%$
test_reinforce_speed[False-None] 7.5672ms 4.6980ms 212.8587 Ops/s 213.1269 Ops/s $\color{#d91a1a}-0.13\%$
test_reinforce_speed[False-backward] 7.8148ms 7.5688ms 132.1218 Ops/s 132.2731 Ops/s $\color{#d91a1a}-0.11\%$
test_reinforce_speed[True-None] 3.1526ms 2.9667ms 337.0719 Ops/s 340.9164 Ops/s $\color{#d91a1a}-1.13\%$
test_reinforce_speed[True-backward] 8.1615ms 7.9021ms 126.5493 Ops/s 122.8756 Ops/s $\color{#35bf28}+2.99\%$
test_reinforce_speed[reduce-overhead-None] 3.0935ms 2.9121ms 343.3950 Ops/s 340.5541 Ops/s $\color{#35bf28}+0.83\%$
test_reinforce_speed[reduce-overhead-backward] 8.3897ms 8.1326ms 122.9625 Ops/s 113.3026 Ops/s $\textbf{\color{#35bf28}+8.53\%}$
test_iql_speed[False-None] 22.7439ms 20.5906ms 48.5659 Ops/s 48.8274 Ops/s $\color{#d91a1a}-0.54\%$
test_iql_speed[False-backward] 32.5421ms 31.4837ms 31.7624 Ops/s 31.8272 Ops/s $\color{#d91a1a}-0.20\%$
test_iql_speed[True-None] 9.3140ms 8.8923ms 112.4573 Ops/s 114.9624 Ops/s $\color{#d91a1a}-2.18\%$
test_iql_speed[True-backward] 17.8943ms 17.2707ms 57.9014 Ops/s 58.1615 Ops/s $\color{#d91a1a}-0.45\%$
test_iql_speed[reduce-overhead-None] 9.1192ms 8.8510ms 112.9814 Ops/s 113.3933 Ops/s $\color{#d91a1a}-0.36\%$
test_iql_speed[reduce-overhead-backward] 18.2880ms 17.7210ms 56.4304 Ops/s 55.1490 Ops/s $\color{#35bf28}+2.32\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2137ms 6.0895ms 164.2162 Ops/s 165.8060 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9788ms 0.3632ms 2.7530 KOps/s 2.8147 KOps/s $\color{#d91a1a}-2.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7668ms 0.3746ms 2.6695 KOps/s 3.6675 KOps/s $\textbf{\color{#d91a1a}-27.21\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1563ms 5.7823ms 172.9427 Ops/s 174.5214 Ops/s $\color{#d91a1a}-0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9809ms 0.3589ms 2.7860 KOps/s 2.9473 KOps/s $\textbf{\color{#d91a1a}-5.47\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5451ms 0.3209ms 3.1167 KOps/s 3.4083 KOps/s $\textbf{\color{#d91a1a}-8.56\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8104ms 1.4508ms 689.2770 Ops/s 770.4299 Ops/s $\textbf{\color{#d91a1a}-10.53\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6156ms 1.3860ms 721.4869 Ops/s 819.9085 Ops/s $\textbf{\color{#d91a1a}-12.00\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0798ms 5.8915ms 169.7368 Ops/s 168.6432 Ops/s $\color{#35bf28}+0.65\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8807ms 0.4945ms 2.0222 KOps/s 1.8699 KOps/s $\textbf{\color{#35bf28}+8.14\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6897ms 0.4763ms 2.0997 KOps/s 2.0070 KOps/s $\color{#35bf28}+4.62\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.0554ms 5.8029ms 172.3274 Ops/s 169.8952 Ops/s $\color{#35bf28}+1.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9195ms 0.3832ms 2.6094 KOps/s 3.0709 KOps/s $\textbf{\color{#d91a1a}-15.03\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6813ms 0.3612ms 2.7685 KOps/s 3.2001 KOps/s $\textbf{\color{#d91a1a}-13.48\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1317ms 5.8507ms 170.9193 Ops/s 171.4143 Ops/s $\color{#d91a1a}-0.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8578ms 0.3454ms 2.8953 KOps/s 3.1294 KOps/s $\textbf{\color{#d91a1a}-7.48\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6610ms 0.3057ms 3.2707 KOps/s 3.4399 KOps/s $\color{#d91a1a}-4.92\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2287ms 6.0074ms 166.4626 Ops/s 167.8919 Ops/s $\color{#d91a1a}-0.85\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.7499ms 0.4840ms 2.0660 KOps/s 2.2278 KOps/s $\textbf{\color{#d91a1a}-7.26\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6776ms 0.4806ms 2.0808 KOps/s 2.2850 KOps/s $\textbf{\color{#d91a1a}-8.94\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.5636ms 5.1163ms 195.4530 Ops/s 195.3037 Ops/s $\color{#35bf28}+0.08\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 8.0158ms 2.4471ms 408.6393 Ops/s 415.2166 Ops/s $\color{#d91a1a}-1.58\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 8.1804ms 1.2558ms 796.3092 Ops/s 823.2624 Ops/s $\color{#d91a1a}-3.27\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.6907s 18.9341ms 52.8147 Ops/s 49.9220 Ops/s $\textbf{\color{#35bf28}+5.79\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 9.7914ms 1.9817ms 504.6133 Ops/s 503.0470 Ops/s $\color{#35bf28}+0.31\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.1914ms 1.2309ms 812.3915 Ops/s 823.4783 Ops/s $\color{#d91a1a}-1.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.0132ms 5.3702ms 186.2123 Ops/s 187.2164 Ops/s $\color{#d91a1a}-0.54\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.7184ms 2.3021ms 434.3834 Ops/s 433.8131 Ops/s $\color{#35bf28}+0.13\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.7679ms 1.3777ms 725.8463 Ops/s 758.6659 Ops/s $\color{#d91a1a}-4.33\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 36.0251ms 33.7866ms 29.5975 Ops/s 29.2675 Ops/s $\color{#35bf28}+1.13\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.3041ms 17.7068ms 56.4753 Ops/s 55.3346 Ops/s $\color{#35bf28}+2.06\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 37.2218ms 35.0170ms 28.5576 Ops/s 28.4332 Ops/s $\color{#35bf28}+0.44\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.8787ms 18.0141ms 55.5120 Ops/s 55.0009 Ops/s $\color{#35bf28}+0.93\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 42.2610ms 37.0717ms 26.9747 Ops/s 27.1810 Ops/s $\color{#d91a1a}-0.76\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.0261ms 19.6370ms 50.9243 Ops/s 49.8687 Ops/s $\color{#35bf28}+2.12\%$

[ghstack-poisoned]
@vmoens vmoens added the Tests Incomplete or broken unit tests label Dec 18, 2025
vmoens added a commit that referenced this pull request Dec 18, 2025
@vmoens vmoens merged commit c60ab7a into gh/vmoens/171/base Dec 18, 2025
96 of 105 checks passed
@vmoens vmoens deleted the gh/vmoens/171/head branch December 18, 2025 14:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Tests Incomplete or broken unit tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants